Acquiring Knowledge from Pre-Trained Model to Neural Machine Translation

نویسندگان
چکیده

برای دانلود رایگان متن کامل این مقاله و بیش از 32 میلیون مقاله دیگر ابتدا ثبت نام کنید

اگر عضو سایت هستید لطفا وارد حساب کاربری خود شوید

منابع مشابه

Pre-Translation for Neural Machine Translation

Recently, the development of neural machine translation (NMT) has significantly improved the translation quality of automatic machine translation. While most sentences are more accurate and fluent than translations by statistical machine translation (SMT)-based systems, in some cases, the NMT system produces translations that have a completely different meaning. This is especially the case when...

متن کامل

Knowledge Extraction From Trained Neural Networks

Received Jul 16 th , 2012 Revised Aug 01 th , 2012 Accepted Sept 02 th , 2012 Artificial neural networks (ANN) are very efficient in solving various kinds of problems But Lack of explanation capability (Black box nature of Neural Networks) is one of the most important reasons why artificial neural networks do not get necessary interest in some parts of industry. In this work artificial neural n...

متن کامل

Knowledge Extraction from Trained Neural Networks

The artificial neural networks (ANNs) are well suitable to solve a variety class of problems in a knowledge discovery field (e.g., in natural language processing) because the trained networks are more accurate at classifying the examples that represent a problem domain. However, the neural networks that consist of large number of weighted connections (called also links) and activation units oft...

متن کامل

FGP: A Virtual Machine for Acquiring Knowledge from Cases

Large case databases are numerous and packed with information. The largest of them are potentially rich sources of domain knowledge. The FGP machine is a software architecture that can make this knowledge explicit and bring it to bear on classification and prediction problems. The architecture provides much of the functionality of traditional expert systems without requiring the system builder ...

متن کامل

Temporal Attention Model for Neural Machine Translation

Attention-based Neural Machine Translation (NMT) models suffer from attention deficiency issues as has been observed in recent research. We propose a novel mechanism to address some of these limitations and improve the NMT attention. Specifically, our approach memorizes the alignments temporally (within each sentence) and modulates the attention with the accumulated temporal memory, as the deco...

متن کامل

ذخیره در منابع من


  با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید

ژورنال

عنوان ژورنال: Proceedings of the AAAI Conference on Artificial Intelligence

سال: 2020

ISSN: 2374-3468,2159-5399

DOI: 10.1609/aaai.v34i05.6465